Temporal Registration using a Kalman Filter for Augmented Reality Applications

نویسندگان

  • Christopher Jaynes
  • Jing Hou
چکیده

Augmented Reality uses see-through head-mounted displays to superimpose synthetically generated information on a three-dimensional scene. Information is rendered in alignment with physical objects to enhance the user’s ability to perceive and interact with the world. A significant technical challenge related to Augmented Reality is determining the transformation that will correctly align the synthetic data with corresponding physical objects. This is made more difficult by the fact that the user and the scene may be in motion. Alignment must be both stable and accurate in order to produce the “illusion” that synthetic objects are an integral part of the environment. This paper presents a tracking algorithm capable of computing the three-dimensional pose of objects with respect to a headmounted camera as they are moved in the scene. Using the fixed transform from the headmounted camera and the see-through device, information can then be displayed in alignment with the current view of the object being tracked. In contrast to approaches that solve for the absolute position of the viewer within a fixed geometry [2,16], this object-centered approach to Augmented Reality models motion of both the object and the camerasdisplay system mounted on the user’s head using a single transformation involving six parameters. Objects to be augmented are first recognized as one of several stored within a database. Once recognized, appropriate feature points are extracted from the image for tracking and auxiliary information, associated with the object model is rendered into the current view. Accurate pose information is maintained using a Kalman filter that combines the predictions of a state-model and the pose of the object computed from tracked feature points and a three-dimensional pose recovery algorithm. The technique is demonstrated on a database of mechanical prototype parts, using a headmounted camera system. We explore the utility of the system in a manufacturing environment where an inspector requires access to CAD information related to a prototype part in order to facilitate qualitative decisions about the object. Results demonstrate that the algorithm is capable maintaining accurate temporal registration between the object and headmounted system at nearly 22Hz on a Sun Ultra Sparc-20 Workstation.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Dynamic registration for augmented reality in telerobotics applications

This paper presents a solution to the dynamic registration problem in augmented reality for telerobotics applications. The objective is to align the virtual camera used to render a 3D graphical replica of a robot manipulator with the real camera providing images from the work site. We proceed in two steps: First, a static registration process requiring the intervention of the operator; Then, a ...

متن کامل

An adaptive estimator for registration in augmented reality

In augmented reality (AR) systems using headmounted displays (HMD's), it is important to accurately sense the position and orientation (pose) of the user's head with respect to the world, in order that graphical overlays are drawn correctly aligned with real world objects. It is desired to maintain registration dynamically (while the person is moving their head) so that the graphical objects wi...

متن کامل

Motion model transitions in GPS-IMU sensor fusion for user tracking in augmented reality

Finding the position of the user is an important processing step for augmented reality (AR) applications. This paper investigates the use of different motion models in order to choose the most suitable one, and eventually reduce the Kalman filter errors in sensor fusion for such applications where the accuracy of user tracking is crucial. A Deterministic Finite Automaton (DFA) was employed usin...

متن کامل

Sensor-Aware Recognition and Tracking for Wide-Area Augmented Reality on Mobile Phones

Wide-area registration in outdoor environments on mobile phones is a challenging task in mobile augmented reality fields. We present a sensor-aware large-scale outdoor augmented reality system for recognition and tracking on mobile phones. GPS and gravity information is used to improve the VLAD performance for recognition. A kind of sensor-aware VLAD algorithm, which is self-adaptive to differe...

متن کامل

Online 6 DOF Augmented Reality Registration from Natural Features

We present a complete scalable system for 6 d.o.f. camera tracking based on natural features. Crucially, the calculation is based only on pre-captured reference images and previous estimates of the camera pose and is hence suitable for online applications. We match natural features in the current frame to two spatially separated reference images. We overcome the wide baseline matching problem b...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 1999